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Digital  Signal  Processing  is  ... 


•  That  discipline  which  has  allowed  us  to 
replace  a  circuit  previously  composed  of  a 
capacitor  and  a  resistor  with  two  anti¬ 
aliasing  filters,  an  A-to-D  and  a  D-to-A 
converter,  and  a  general  purpose  computer 
(or  array  processor)  so  long  as  the  signal  we 
are  interested  in  does  not  vary  too  quickly.” 

-  Prof.  Tom  Barnwell,  Georgia  Tech 
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Reliance  on  Moore’s  Law 


•  Doing  our  signal  processing  digitally  has  allowed  us 
to  grow  our  capability  with  Moore’s  Law  ... 
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•  ...  but  puts  our  rate  of  growth  at  risk  if  it  begins  to 
falter 
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Elements  Contributing  to  Embedded 
Processor  Performance 


Signal  Processor 


/ 

\ 

Hardware 

Software 

_ / 1 
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1C  Devices 

Computer 

Architecture 

Algorithms 

Functionality 

The  software  side  of  DSP  provides  another 
path  to  exponential  growth  in  capability 
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Years  of  Hardware  Improvement 
Required  for  Equal  Computational  speedup 


Moore’s-Law  Equivalent  Years  Required 
to  Match  FFT  Computational  Speedup 


Radix-2  FFT  Length 
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Different  Character  of  Hardware  (1C) 

vs. 

Algorithm  Improvements 


Improvement 

Metrics 

Hardware 

Algorithms 

Regularity 

Predictable 

Unpredictable 

Dependent  variable 

Time 

Order  complexity 

Impact  on  applications 

Incremental 

Leap-ahead 

Useful  lifetime 

3  years  or  less 

10  years  or  more 

R&D  Cost  growth 

2x  in  3  years 

1.1  lx  in  3  years 
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Types  of  Algorithm  Contributions 


Improved  efficiency  of  existing  functionality 

-  Quicksort,  FFT:  N2  NlogN 

-  Fast  multipole  algorithm:  N2  N 

Architecture-aware 
implementations 

-  FFTW:  discrete  Fourier  transforms 

-  ATLAS:  linear  algebra 

-  SPIRAL:  DSP  algorithms 

Entirely  new  Functionality 


1C  Devices 


Signal  Processor 

Z 


Computer 

Architecture 


Algorithms  Functionality 


-  Creates  capability  not  achievable  with  any  amount  of 
hardware  speedup 

-  Example:  voice  recognition  using  parametric  modeling  and 
HMMs  instead  of  vocoders  and  1960s  pattern  recognition 

-  Wavelets,  quantum  signal  processing,  nonlinear 
techniques,  knowledge-based  and  cognitive  techniques, 
etc. 
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Wafer-Fab  Capitalization  Cost  Compared  to 

Annual  DSP  Algorithm  R&D  Costs 
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Algorithms  Provide  ... 

•  The  other  half  of  implementation 
speedup 

•  Entirely  new  functionality 

•  Non-exponential  cost  growth 

•  A  way  forward  if  hardware  speed  ups 
slow! 
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